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1 Introduction 

Speech communication, i.e. delivering and receiving 
auditory signals containing linguistic information, is 
an effective and important part of human interaction. 
Since speech processing and the underlying 
activation changes in cortical networks are known to 
happen extremely fast, speech processing is best 
studied with electro-magnetic brain imaging 
techniques such as EEG and MEG which have a 
temporal accuracy of a millisecond range [1]. An 
object of interest here is the processing by which the 
listener derives the semantic content embedded in 
the acoustic signal as well as the cortical areas 
involved in the process. These questions have often 
been studied with EEG using the N400-paradigm 
originally constructed for studies of reading 
comprehension [2]. 

Based on the numerous EEG studies both the visual 
and auditory N400 responses are thought to reflect 
modality-independent top-down processing that 
involves semantic memory functions (for a review, 
see [3]). In sentence-processing studies (as opposed 
to single-word studies) the N400 is elicited, for 
instance, in response to a word that does not fit the 
idea conveyed by the rest of the sentence [2,4]. 
Although the auditory and visual N400 responses 
are elicited in similar conditions [5-8], they have 
some differences the reasons of which have 
remained unresolved. Namely, the visual N400 
seems to be of a shorter duration, which is reflected 
in the sharper form of the response in comparison to 
the broad auditory N400. This has been proposed to 
result from variable durations and recognition points 
of the target words [4,9,10] or from overlapping 
phonological and semantic processing [11]. In 
addition, since the individual responses have been of 
a somewhat shorter duration (sharper form) than the 
grand-averaged waveforms of subjects, it has also 
been suggested that the long duration of the auditory 
N400 response might be due to temporal differences 
of individual processing strategies [12]. The possible 
contribution of stimulus duration per se on the 
auditory N400 has also been mentioned [10]. It 


seems, then, that despite the excellent temporal 
resolution provided by MEG and EEG, the temporal 
smearing underlying the generation of the auditory 
N400(m) remains to be established. 

In addition to this temporal smearing, the location(s) 
of the cortical networks underlying the generation of 
the N400 are still unknown. A few studies on the 
visual N400m have been conducted using MEG [13- 
15] although at present, to our knowledge, there are 
no published reports on the auditory magnetic 
N400m response. We have recently conducted 
several experiments for eliciting an N400m response 
which could reliably be located by single current 
dipole estimation. As a starting point, we used 
stimuli very similar to those of previous EEG 
experiments, i.e. words of long, slightly variable 
durations. However, source localisation of the 
resulting response by dipole estimation turned out to 
be impossible. By systematically modifying the 
details of the experimental set-up we studied the 
prerequisites of the reliable elicitation of the 
auditory N400m in MEG. 

2 Methods 

2.1 Subjects 

The subjects were normal-hearing, right-handed 
adults either fluent in (N = 16, age 23-33 years) or 
with no knowledge of Finnish (N = 5, age 22-31 
years). The subjects provided informed consent and 
the experiment was approved by the Ethical 
Committee of Helsinki University Central Hospital. 

2.2 Materials 

The stimuli consisted of 480 different sentences that 
ended either with a probable or an improbable noun 
of either long or short duration. The sentences were 
thus divided into four groups of 120 sentences 
according to the sentence-ending word that was: 

1. A congruent long-duration final word: 

I would like to have a sandwich. 

2. An incongruent long-duration final word: 

aunt is knitting a computer. 



3. A congruent short-duration final word: 

I always drink coffee from a cup. 

4. An incongruent short-duration final word: 

*At a dentist you open your cup. 

The sentences were first recorded using a DAT- 
recorder (DAT 44 Daz, microphone SM 10A) and 
then transferred onto a computer. Each sentence was 
produced at a normal speech rate by a female 
speaker in a sound-attenuated room. Careful 
measures were taken in order to avoid distorting the 
coarticulation and giving the listener false cues 
which might affect the ERPs: all sentences were 
produced as a whole instead of, for example, 
transposing a separately produced final word to the 
end of the sentence. The target words were then 
triggered from the point where the last phoneme of 
the preceding word changed towards the first 
phoneme of the target word and was thus affected by 
coarticulation. This was accomplished by careful 
monitoring of the signal and the use of an 
oscillogram. 

2.3 Procedure 

The stimuli, divided into four sequences containing 
the same number of each sentence type, presented in 
pseudo-random order (not more than 3 sentences of 
the same class followed each other) and lasting 12 
minutes each, were delivered to the subjects 
binaurally through plastic tubes and ear pieces. The 
sound pressure level of the presentation was 
approximately 65 dB SPL. The subject’s task was to 
listen carefully and to press a response pad each 
time the meaning of the sentence sounded odd. In 
order to make sure that even non-Finnish speaking 
subjects listened attentively they were instructed to 
search for possibly familiar items ( e.g. “Helsinki”) 
in the stimulation. 

2.4 Recordings 

Cortical activity was measured simultaneously with 
a 122-channel magnetometer (Neuromag Ltd.) and 
five EEG electrodes (Fpz, Fz, Cz, Pz, Cz) placed on 
the scalp using the 10/20-system and referenced to 
linked mastoids. Horizontal and vertical eye 
movements and blinks were recorded and epochs 
during which the EOG magnitude exceeded 150 pV 
were discarded from the data. A minimum of 100 
epochs per sentence type were averaged time-locked 
to the sentence-ending word (pass-band filtering 1- 
20 Hz). Source localisation was performed using 
equivalent current dipoles (ECDs). 


3 Results 

3.1 The Finnish-speaking subjects 

As illustrated in Figure 1 the magnetic (la) and 
electric (lb) responses were very similar. The long- 
duration incongruent words evoked a low-amplitude 
response that seemed to be scattered in time and had 
no clearly observable peak. Locating this response 
by ECDs was not possible. In contrast, the short- 
duration incongruent word evoked a strong response 
peaking at around 420 ms in both hemispheres. 




Figure 1: Grand averaged MEG (a) and EEG (b) 
waveforms of Finnish subjects. The short-duration 
improbable word evoked a response peaking at 
around 420 ms (depicted in red). Long-duration 
words evoked the responses depicted in black. 

Source localisation of the EMF elicited by the short- 
duration incongruent word was straightforward and 
reliable: the average goodness-of-fit of the dipole 
was 82.5 % in the left and 83.6% in the right 
hemisphere (Figure 2). Although inter-individual 
differences were observed, the ECD localisation 
suggested a generator mechanism in the vicinity of 
the auditory cortex. 


Figure 2: Dipoles of a single representative subject 
fitted at 420 ms from the onset of the short 
improbable word. Because of the strength and short 
duration of the elicited response the dipole fitting 
was reliable: the average goodness of fit of all 
subjects was 82.5% on the left and 83.6% on the 
right hemisphere. 










3.2 The non-Finnish-speaking subjects 

Neither the short- nor the long-duration words 
evoked a response at around 400 ms in the non- 
Finnish-speaking subjects (Figures 3a and 3b). This 
occurred despite all the subjects noticing the 
repeated occurrence of the short-duration sentence¬ 
ending word. This was indicated by their response- 
key press after each occurrence of the ending word. 



Figure 3: Grand-averaged MEG (a) and EEG (b) 
waveforms of non-Finnish-speaking subjects. 
Neither the short- nor the long-duration words 
evoked a response at around 400 ms. 

4 Discussion 

To our knowledge, the are no published reports on 
the magnetic counterpart of the auditory N400 to 
date. Based on our present observations, one reason 
for this lack of data on N400m might be that the 
duration of the stimulus words has been overlooked. 
We found it impossible to locate the source of the 
response elicited by the long-duration words. On the 
contrary, estimating the source of the response 
elicited by short-duration words was reliable and 
straightforward. 

Our data therefore suggests that the short duration of 
the stimulus word is an important prerequisite for 
source localisation of the auditory N400m. Stimulus 
duration might even determine the extent to which 
we can benefit from the excellent temporal 
resolution of both EEG and MEG: on the one hand, 
short-duration words seem to elicit a response the 
peak latency of which can easily be defined. On the 
other, long-duration words evoke a response the 
peak latency of which is difficult to define or it has 
to be defined by mathematical operations. 
Furthermore, the broad auditory N400 observed in 
previous EEG-measurements has been suggested to 
reflect 1) overlapping phonological and semantic 
processing, 2) variable recognition points of the 
target words or 3) temporal processing differences 
between subjects. However, based on the present 
observations as well as data from an experiment 
(Makela et ah, in preparation) where only one 


incongruent sentence-ending long-duration word 
was used (and the variation in stimulus-duration was 
thus eliminated), we suggest that this broad form of 
the N400(m) might be due to the long duration of 
the target words (see [16,17]). 

Since the responses elicited by the long-duration 
words were not identical in the Finnish and non- 
Finnish-speaking subjects (which could be expected 
if the response was a purely physiological reaction 
to a long-duration acoustic signal), it is possible that 
the long-duration responses also reflect aspects of 
lexical processing. Then again, since the short- 
duration word did not evoke a response in the non- 
Finnish-speaking subjects even though they 
recognised the phonetic pattern of the word, it is 
unlikely that the response observed in Finnish 
subjects would be an “offset”-response reflecting a 
merely physiological process caused by the ending 
of the stimulus. 

In conclusion, we propose that the elicitation of the 
response observed in Finnish subjects requires 
recognition of the semantic content embedded in the 
acoustic pattern and that this response is very likely 
the auditory N400m, the magnetic counterpart of the 
electric auditory N400. Whether this response 
reflects the combining of the content and form or 
semantic processing only will be addressed 
elsewhere (Tiitinen et al., in preparation, Makela et 
al. in preparation). At present, we note that in future 
studies of the N400(m) utilising auditory stimuli, 
close attention should be paid to the stimulus 
duration per se. 

Acknowledgements 

This research was supported by University of 
Helsinki, and the European Commission - DG XII, 
and the Joint Interpretation and Conference Service. 

References 

1. M. Hamalainen, R. Hari, R. J. Ilmoniemi, 
J. Knuutila, and O.V. Lounasmaa, ’’Magnetoence¬ 
phalography - theory, instrumentation and 
applications to non-invasive studies of the 
working human brain”, Rev Mod Phys 65, 413- 
497, 1993. 

2. M. Kutas and S.A. Hillyard, ’’Reading senseless 
sentences: brain potentials reflect semantic 
incongruity”, Science 207, 203-205, 1980. 

3. M. Kutas and R. Kluender, “What is who 
violating: a reconsideration of linguistic violations 
in light of event-related potentials.” In H. Heinze, 
T. Muente and G.R. Manguen (eds.) Cognitive 






electrophysiology. Boston: Birkhauser, 1994, 
pp.183-210. 

4. W.C. McCallum, S.F. Farmer, and P.V. Pocock, 
’’The effects of physical and semantic incongruities 
on auditory event-related potentials”, Electro- 
enceph Clin Neurophys 59,477-488, 1984. 

5. P.J. Holcomb and H.J. Neville,’’Auditory and 
visual semantic priming in lexical decision: a 
comparison using evoked potentials”, Lang 
CognProc 5,281-312, 1990. 

6. J.E. Anderson and P.J. Holcomb, “Auditory and 
visual semantic priming using different stimulus 
onset asynchronies: An event-related brain 
potential study”, Psychophys 32, 177-190, 1995. 

7. J.F. Connolly and N.A. Phillips,’’Event-related 
potential components reflect phonological and 
semantic processing of the terminal word of 
spoken sentences”, J Cogn Neurosci 6, 256-266 
,1994. 

8. J.F. Connolly, N.A. Phillips, and K.A.K Forbes, 
“The effects of phonological and semantic 
features of sentence-ending words on visual 
event-related potentials”, Electroenceph Clin 
Neurophys 94, 276-287 1995. 

9. J.P. O’Halloran, R. Isenhart, C.A. Sandman, and 
L.S. Larkey, “Brain responses to semantic 
anomaly in natural, continuous speech”, Int J 
Psychophys 6, 243-254, 1988. 

10. S. Bentin, M. Kutas, and S.A. Hillyard, 
“Electrophysiological evidence for task effects 


on semantic priming in auditory word 
processing 64 , Psychophys 30, 161-169, 1993. 

11. P. Praamstra and D.F. Stegeman, ’’Phonological 
effects on the auditory N400 event-related 
potential”, Cogn Brain Res 1, 73-86, 1993. 

12. J.F. Connolly, N.A. Phillips, and S.H. Stewart, 
“Event-related potential sensitivity to acoustic and 
semantic properties of terminal words in 
sentences”, Brain Lang 43, 1-18, 1992. 

13. P.G. Simos, L.F.H. Basile, and A.C. Papanicolau, 
’’Source localisation of the N400 response in a 
sentence-reading paradigm using evoked magnetic 
fields and magnetic resonance imaging”, Brain Res 
762,29-39,1997 

14. P. Helenius, R. Salmelin, E. Service, and 
J.F. Connolly, ’’Distinct time courses of word and 
context comprehension in the left temporal cortex”, 
Brain 121, 1133-1142, 1998. 

15. M. Laine, R. Salmelin, P. Helenius and 
R. Marttila, “Brain activation during reading in 
deep dyslexia: an MEG study”, J Cogn Neurosci 
12, 622-634, 2000. 

16. T.W. Picton, D.L. Woods, and G.B. Proulx, 
’’Human auditory sustained potentials. 1. The 
nature of the response” Electroenceph Clin 
Neurophys AS, 186-197, 1978. 

17. R. Hari, M. Hamalainen, E. Kaukoranta, et al. 
’’Selective listening modifies activity of the 
human auditory cortex”, Exp Brain Res 74, 463- 
470, 1989. 



